A Restless Bandit Marginal Productivity Index for Opportunistic Spectrum Access with Sensing Errors
نویسنده
چکیده
• Opportunistic spectrum access (OSA) in cognitive radio networks: using efficiently the radio frequency spectrum • Traditional static spectrum allocation to licensed primary users (PUs): severe inefficiencies, measurements indicate low spectrum utilization (under 30 %) • Dramatic demand surge for spectrum access by unlicensed secondary users (SUs), due to emerging technologies • OSA: dynamically exploit transmission opportunities created by PUs' bursty usage patterns, granting SUs access to licensed channels when these are perceived to be unused Background: OSA policies & sensing errors • OSA: dynamically exploit transmission opportunities created by PUs' bursty usage patterns, granting SUs access to licensed channels when these are perceived to be unused • Surge of research on design of OSA policies for dynamic spectrum allocation to SUs: tractable & near-optimal
منابع مشابه
On Optimality of Myopic Policy for Restless Multi-armed Bandit Problem with Non i.i.d. Arms and Imperfect Detection
We consider the channel access problem in a multi-channel opportunistic communication system with imperfect channel sensing, where the state of each channel evolves as a non independent and identically distributed Markov process. This problem can be cast into a restless multi-armed bandit (RMAB) problem that is intractable for its exponential computation complexity. A natural alternative is to ...
متن کاملA Restless Bandit Formulation of Multi-channel Opportunistic Access: Indexablity and Index Policy
We focus on an opportunistic communication system consisting of multiple independent channels with time-varying states. With limited sensing, a user can only sense and access a subset of channels and accrue rewards determined by the states of the sensed channels. We formulate the problem of optimal sequential channel selection as a restless multi-armed bandit process, for which a powerful index...
متن کاملMulti-channel opportunistic access : a restless multi-armed bandit perspective. (Accès opportuniste dans les systèmes de communication multi-canaux : une perspective du problème de bandit-manchot)
Cognitive radio, first envisioned by Mitola, is the key enabling technology for future generations of wireless systems that addresses critical challenges in spectrum efficiency, interference management, and coexistence of heterogeneous networks. The core concept in cognitive radio networks is opportunistic spectrum access, whose objective is to solve the imbalance between spectrum scarcity and ...
متن کاملIndexability of Restless Bandit Problems and Optimality of Index Policies for Dynamic Multichannel Access
We consider an opportunistic communication system consisting of multiple independent channels with time-varying states. With limited sensing, a user can only sense and access a subset of channels and accrue rewards determined by the states of the sensed channels. We formulate the problem of optimal sequential channel selection as a restless multi-armed bandit process. We establish the indexabil...
متن کاملRestless Bandit Marginal Productivity Indices, Diminishing Returns, and Optimal Control of Make-to-Order/Make-to-Stock M/G/1 Queues
This paper presents a framework grounded on convex optimization and economics ideas to solve by index policies problems of optimal dynamic allocation of effort to a discrete-state (finite or countable) binary-action (work/rest) semi-Markov restless bandit project, elucidating issues raised by previous work. Its contributions include: (i) the concept of a restless bandit’s marginal productivity ...
متن کامل